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EXCHANGEABLE MARKOV PROCESSES ON GRAPHS: PEELER CASE 


HARRY CRANE 


Abstract. The transition law of every exchangeable Feller process on the space of countable 
graphs is determined by a n-finite measure on the space of |0,1) x |0, l}-valued arrays, hr 
discrete-fime, fhis characferization amounts to a construction from an independent, iden¬ 
tically distributed sequence of exchangeable random functions. In continuous-fime, the 
behavior is enriched by a Levy-lto-type decomposition of fhe jump measure into mutually 
singular components that govern global, vertex-level, and edge-level dynamics. Further¬ 
more, every such process almost surely projects to a Feller process in the space of graph 
limits. 


1. Introduction 


A graph, or network, G = (V,Ec) is a set of vertices V and a binary relation of edges 
Eq <zV xV. For i, j e V, we write G’t to indicate the status of edge (i, j), i.e.. 



We write to denote the space of graphs with vertex set V. 

Networks represent interactions among individuals, particles, and variables throughout 
science. In this setting, consider a population of individuals labeled distinctly in V and 
related to one another by the edges of a graph G = {V, Eq). The population size is typically 
large, but unknown, and so we assume a countably infinite population and take 1/ = N := 
{1,2,...]. In practice, the labels N are arbitrarily assigned for the purpose of distinguishing 
individuals, and data can only be observed for a finite sample S c IN. Thus, we often take 
S = [n] := {1,..., n} whenever S c IN is finite with cardinality n > 1. 

These practical matters relate to the operations of 

• relabeling: the relabeling of G = (G'^),j>i by any permutation a : IN —> IN is 


and 

• restriction: the restriction of G = (G*^),^j>i to a graph with vertices S c IN is 

G^ = G|s := {G%,jes. 


( 1 ) 


( 2 ) 


In many relevant applications, the network structure changes over time, resulting in a 
time-indexed collection {Gt)teT of graphs. We consider exchangeable, consistent Markov 
processes as statistical models in this general setting. 
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1.1. Graph-valued Markov processes. A Qj^-valued Markov process is a collection T = {Fg : 
G 6 for which each Fg = iTt)teT is a family of random graphs satisfying Fq = G and 

• the Markov property, i.e., the past (Fs)s<f and future (Fs)s>f are conditionally indepen¬ 
dent given the present Ff, for all t eT. 

In addition, we assume F is 

• exchangeable, i.e., all Fg share a common exchangeable transition law such that 

(3) F{Tr e-\Tt = F} = ¥{!<;, e-\T‘^ =F}, F e t'> t, and 

• consistent, i.e., the transition law of F satisfies 

(4) P{fW =F\Tt = F'} = P{rM =F\Tt = f"}, F € 

for all F',F" € such that F'\[„] = F''\[„], for every n 6 N. 

Consistency implies that F^^ = (Ff|[„])tgr satisfies the Markov property for every n e 
N, for all G 6 We call any F satisfying these properties an exchangeable, consistent 
Markov process. In Proposition I4.3[ we observe that consistency and the Feller property 
are equivalent for exchangeable Markov processes on Q-^, so we sometimes also call F an 
exchangeable Feller process. 

The process F = {Fg : G e is enough to determine the law of any collection (Ft)tg 7 ’ 
with a given transition law and initial distribution v by first drawing Fq ~ v and then 
putting Fv = Fg on the event Fq = G. With the underlying process F = {Fg : G e 
understood, we write F^ = (Ft)tg 7 to denote a collection with this description. 

Our main theorems characterize the behavior of exchangeable Feller processes in both 
discrete- and continuous-time. In discrete-time, we show that every exchangeable Feller 
process can be constructed by an iterated application of independent, identically distributed 
exchangeable random functions called rewiring maps; see Section 14.51 In 

continuous-time, F admits a construction from a Poisson point process whose intensity 
measure has a Levy-Ito-type decomposition. The Levy-Ito representation classifies every 
discontinuity of F as one of three types. In addition, when v is an exchangeable initial 
distribution on both discrete- and continuous-time processes Fv project to a Feller pro¬ 
cess in the space of graph limits. These outcomes invoke connections to previous work on 
the theory combinatorial stochastic processes llUlOl, partially exchangeable arrays IIl|2j|5l, 
and limits of dense graph sequences HHHH. 

1.2. Outline. Before summarizing our conclusions (Sectionj^, we first introduce key def¬ 
initions and assumptions (Section |2l). We then unveil essential concepts in more detail 
(Section ID) and prove our main theorems in discrete-time (Section 0 and in continuous¬ 
time (Section 1^. We highlight some immediate extensions of our main theorems in our 
concluding remarks (Section {7)). 

2. Definitions and assumptions 

2.1. Graphs. For any graph G = (V, Eg), we impose the additional axioms of 

(i) anti-reflexivity, {i, i) ^ Eg for all i € V, and 

(ii) symmetry, {i, j) e Eg implies (;, i) e Eg for all i, j e V. 

Thus, we specialize to denote the set of all graphs satisfying (i) and (ii). 

By the symmetry axiom (ii), we write ij = {i, ]} 6 Eg to indicate that there is an edge 
between i and j in G. By definition, G has no multiple edges, condition (i) forbids edges 
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from a vertex to itself, and condition (ii) makes G undirected. In terms of the adjacency array 
G = (i) and (ii) above correspond to 

(i') G" = 0 for all i € V and 
(iiO G'V = G/'foralli,7€y, 

respectively. As we discuss in Section [7[ our main theorems remain valid under some 
relaxation of each of these conditions. The above two notions of a graph—as a pair (V, Eq) 
and as an adjacency array—are equivalent; we use them interchangeably and with the 
same notation. 

With Qy denoting the space of permutations of V" c N, i.e., bijective functions a : V ^ V, 
relabeling ([T]) associates every o e Sy to a map ^y —> ^y. For all S c S' c y, restriction (O 
determines a map ^s' ^S/ G G® = G|s. Specifically, for n > m> 1, G\[m] = {G^^)i<iy<m 

is the leading mxm submatrix of G = {G't)i<iy<n. By combining ([T]) and (|2]), every injection 
(/) : S —> S' determines a projection Qs' ^ by 

(5) G ^ G'^' := 

We call a sequence of finite graphs (G„)„g]N compatible if G„ e ^[„] and G„\[m] = Gm for 
every m <n, for all n e N. Any compatible sequence of finite graphs determines a unique 
countable graph Goo, the projective limit of (Gi, G 2 ,...) under restriction. We endow with 
the product-discrete topology induced, for example, by the ultrametric 

(6) d(G,G') := 1/ maxjn e N : G|[„] = G'|[„]}, G, G' e • 

From (|6l), we naturally equip with the Borel a-field o( •|[n])neN generated by the restric¬ 
tion maps. Under (|6]l, is a compact and, therefore, complete and separable metric space; 
hence, is Polish and standard measure-theoretic outcomes apply in our analysis. 

2.2. Graph limits. For n > m > 1, F e Q[m], and G € Q[n], we define the density ofF in G by 

(7) 6(F,G):=ind(F,G)/ni'", 

where ind(F, G) is the number of embeddings of F into G and n^^ := n{n - 1) ■ ■ ■ (n - m + 1). 
Specifically, 

ind(f,G):= Y, MG‘1’= F} 

(p:[m]—>[n] 

is the number of injections (p : [m] —> [n] for which G^ = F. 

Given a sequence G = (GnjneiN in '■= UneN ^In], we define the limiting density ofF in G 
by 

6(F, G) := lim 6(F, G„), if it exists. 

n—>oo 

In particular, for G e we define the limiting density ofF in G by 

(8) 6{F, G) := lim 6(F, G|r„]), if it exists. 

Definition 2.1 (Graph limit). The graph limit ofGe is the collection 

|G| := (6(F,G))pgu..,^,.,. 

provided 6{F, G) exists for every F e UmeN ^[m]- If 6(iv G) does not exist for some F, then we put 
|G| := d. We write D* to denote the closure of{\G\ : G e ^jn} \ {d} in [0, IjUmeN 
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If the graph limit of G exists, then G determines a family of exchangeable probability 
distributions on {Q\n\)net^ by 

(9) P{r„=F|G} = 6(F,G), F6^[„], neTN. 

Moreover, the distributions determined by (6(F, G))fg^j^j and {6{F, G))f(zg^^^y m < n, are 
mutually consistent, i.e., the distribution in (|9]) satisfies 

P{r,|[„,] = F'I G} = Yj b(F,G) = 6(r,G), for every F'6 . 

Thus, every D e D* determines a unique probability measure on which we denote by 
Yd- In addition, yu is exchangeable in the sense that T ~ yu satisfies T'^ =£ Y for all o € S]n, 
where =£ denotes equality in law. 

Remark 2.2. In our notation, D e D* and yo correspond to the same object, but we use the former 
to emphasize that D is the graph limit of some G e and the latter to specifically refer to the 
probability distribution that D determines on As an element ofD*, D = (Df )fgg:. is an element 
of[0, l]UmeiN Sim]_ jpg counectlon between D and yo is made explicit by 

Dp = D{F) = pdCIG e : G|[„] = F}), F 6 ^[„], « 6 N. 

Definition 2.3 (Dissociated random graphs). A random graph T is dissociated if 

(10) ris and TIs^ are independent for all disjoint subsets S, S'Q'N . 

We call a probability measure v on dissociated ifT ~ v is a dissociated random graph. 

Dissociated measures play a central role in the theory of exchangeable random graphs: 
the measure yo determined by any D e D* is dissociated, and conversely the Aldous- 
Hoover theorem (Theorem 142]) states that every exchangeable probability measure on 
is a mixture of exchangeable, dissociated probability measures. In particular, to every 
exchangeable probability measure v on there exists a unique probability measure A on 
tD* such that v = y^, where 

(11) yA(-):= r yoi-MdD) 

JO' 

is the mixture of yo measures with respect to A. 

2.3. Notation. We use the capital Roman letter G to denote a generic graph, capital Greek 
letter T to denote a random graph, bold Greek letter with subscript T, to denote a collection 
of random graphs with initial condition •, and bold Greek letter T = {T,} to denote a 
graph-valued process indexed by the initial conditions •. 

Superscripts index edges and subscripts index time; therefore, for {YfjteT, we write T*-^ to 
indicate the status of edge ij at time t € T and T^, = {Tf)teT' to denote the trajectory of the 
edges ij c S c N over the set of times in T' c T. We adopt the same notation for processes 
r = {Tg : G € with T®, := {T^ j., : G e denoting the restriction of T to edges ij e S 
and times T' c T. 

We distinguish between discrete-time (T = Z+ := {0,1,2,...}) and continuous-time (T = 
R+ := [0, oo)) processes by indexing time by m and t, respectively; thus, {Ym)m>o denotes a 
discrete-time process and (Tt)t>o denotes a continuous-time process. To further distinguish 
these cases, we call T a Markov chain if its constituents are indexed by discrete-time and a 
Markov process if its constituents are indexed by continuous-time. Whenever a discussion 
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encompasses both discrete- and continuous-time, we employ terminology and notation for 
the continuous-time case. 


3. Summary of main theorems 

We now state our main theorems, saving many technical details for later. Of primary 
importance are the notions of rewiring maps and rewiring limits, which we introduce 
briefly in Section I3d1 and develop formally in Section [431 


3.1. Discrete-time Feller chains. Let W = {\N^^)qev be a symmetric {0,1} x |0, Ij-valued 
array with W" = (0,0) for all i e V. For i, j e V, we express fhe (i, j) component of W as a 
pair W'-' = (Wq , W'^). For any such W and any G € we define the rewiring ofGbyW by 
G' = W(G), where 


( 12 ) 


I wy, Gi = 0 

I W'j, Gi = 1 


i,jeV. 


Note that W acts on G by reconfiguring its adjacency array at each entry: if G'^ = 0, fhen G'*^ 
is taken from W^; otherwise, G'^i is taken from Thus, we can regard W as a function 
Qvt called a rewiring map. Lemma 1491 records some basic facts about rewiring maps. 
Our definition of relabeling and resfricfion for rewiring maps is identical to definitions 
(d) and (|2| for graphs, i.e., for every o € Sy and S G V, we define 

W‘" := and 

WS = W|s := iW%eS- 


We write 'Wy to denote the collection of rewiring maps Qv- 

Given a probability measure co on 'TL'n, we construct a discrete-time Markov chain 
F^ = {Fg^ : G e as follows. We first generate Wi, W 2 ,... independent and identically 
distributed (i.i.d.) according to oj. For every G e we define F^ ^ = {Tl^)m>o by puffing 
F* = G and 

(13) r; := w,„(r;_,) = (w^ o... o Wi)(G), m>i, 

where W o W' indicates the composition of W and W' as maps 

From fhe definition in (IT2ll . F^ in flSl) is a consistent Markov chain. If, in addition, 
W ~ cu satisfies for all permutations a : N —> IN, then F^ is also 

exchangeable. Theorem 13.11 establishes the converse: to every discrete-time exchangeable, 
consistent Markov chain F = {Fq : G e there corresponds a probability measure o) on 
TLin such that F =£ F^, that is, Fg =£ F^ ^ for all G e 

By appealing to the theory of partially exchangeable arrays, we further characterize co 
uniquely in terms of a mixing measure Y on the space of rewiring limits, which we express 
as CO = Dr- We present these outcomes more explicitly in Section 1431 


Theorem 3.1 (Discrete-time characterization). Let F = {F^ : G e ^jnI be a discrete-time, 
exchangeable, consistent Markov chain on Then there exists a probability measure T such 
that F=£F:^, where FI^ is constructed as in (|I^ from Wi,W 2 ,... independent and identically 
distributed according to co = Qr- 
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Our proof of Theorem 13.11 relies on an extension (Theorem I5.1D of the Aldous-Hoover 
theorem fTheorem l4.2|l to the case of exchangeable and consistent Markov chains on {0,1|- 
valued arrays. Heuristically, Wi, W 2 ,... must be i.i.d. because of the Markov and consis¬ 
tency assumptions: by consistency, every finite restriction T^^ has the Markov property 
and, therefore, for every m>l the conditional law of W^, given T^-i, must satisfy 

and are independent for every n € N; 

exchangeability further requires that is independent of and so we expect Wm to 
be independent of T^-i for every ?« > 1; by time-homogeneity, Wi, W 2 ,... should also be 
identically distributed; independence of Wi, IV 2 ,... then follows from the Markov property. 
Each of these above points on its own requires a nontrivial argument. We make this heuristic 
rigorous in Section 


3.1.1. Projection into the space of graph limits. From our discussion of graph limits in Section 
12.21 any exchangeable random graph T projects almost surely to a graph limit |r| = D, which 
corresponds to a random element yo in the space of exchangeable, dissociated probability 
measures on^N. Likewise, any exchangeable rewiring map W e TEin projects to a rewiring 
limit |W| = u, which corresponds to an exchangeable, dissociated probability measure Qj, 
on TVin. We write G* and 'V* to denote the spaces of graph limits and rewiring limits, 
respectively. 

We delay more formal details about rewiring limits until Section 1431 For now, we settle 
for an intuitive understanding by analog to graph limits. Recall the definition of y^ in (|TT]l 
for a probability measure A on G*, i.e., T ~ yA is a random graph obtained by first sampling 
D ~ A and, given D, drawing T from y^. Similarly, for a probability measure T on 'V*, 
W ~ Qx is a random rewiring map obtained by first sampling u ~ T and, given v, drawing 
W from In particular, W ~ Qx implies |W| ~ T. Just as for graph limits, we regard 
V 6 'V* and □„ as the same object, but use the former to refer to a rewiring limit of some 
W e TV]n and the latter to refer to the corresponding exchangeable, dissociated probability 
distribution on TFin. 

From the construction of T^ in ([l9ll . every probability measure co on TFisi determines a 
transition probability ■) on by 


(14) P„(G,-):=cy({W6TV]N: W(G)e-}), G 6 


and thus every v e 'V* determines a transition probability Py(-, •) by taking co = Q,, in (|l4)l . 
Consequently, every v e'V* acts on G* by composition of probability measures, 

(15) D^Dv{-):= f P,{G,-)yD{dG). 

In other words, Dv is the probability measure of T' obtained by first generating T ~ yo and, 
given T = G, taking T' = W(G), where W ~ □„ is a random rewiring map. 

Alternatively, we can express D as a countable vector (D(P))fgg:. with 


D(F) := yoiiG e : G|[„] = f}), f e n e N. 

Moreover, v gives rise to an infinite by infinite array (u(P,P0)F,F'e^* with 

/ Q,({W 6 TVn : W|[„](P) = f'j), F,F' e for some n 6 N, 
^ ■ I 0, otherwise. 
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In this way, (v(F,F'))p^p^g- has finitely many non-zero entries in each row and the usual 
definition of Dv = {D'{F))p^g- by 

(16) D'{F):= D{F’)v{F',Fl F e n € N, 

coincides with (HSl) . (Note that the array {v{F, F'))p^peg- does not determine v, but its action 
on D* through (IT^ agrees with the action of u in (fl^ d 

For a graph-valued process F = {Fg : G 6 ^jn}, we write F^). = {Fd : D e D*} to denote 
the process derived from F by defining fhe law of Fq = {Ft)teT as that of the collection of 
random graphs obfained by taking Fq ~ yo and, given Fq = G, putting Fd = Fg. Provided 
IFfl exists for all t e T, we define I Pd I (IPtDfeT as the collection of graph limits at all 
times of Fj). If I Fd | exists for all D 6 D*, we write | F 25 . | := {| F^ | : D € D*} to denote the 
associated D*-valued process. 

Theorem 3.2 (Graph limit chain). Let F = {Fg : G e be a discrete-time, exchangeable Feller 
chain on Then \ Tjy\ exists almost surely and is a Feller chain on D*. Moreover, | Fo | =£ ^ 

for every D e TT, where := (D*„)m>o satisfies D*^ = D and 

(17) D;„:=D*^_^Y,^ = DY^■■■Y^, m > 1 , 

with Yi, Y 2 ,... i.i.d.from T, the probability measure associated to F through Theorem IXH 

3.2. Continuous-time Feller processes. In discrete time, we use an i.i.d. sequence of 
rewiring maps fo construct the representative Markov chain F^, cf. Equation (fl^ and 
Theorem 13.11 In continuous time, we construct a representative Markov process F^ = 
{Fg ^ : G € ^]n} from a Poisson point process W = {{t, Wf)} c [0, 00 ) x TVin with intensity 
dt (8 CO. Here, dt denotes Lebesgue measure on [0, 00 ) and co satisfies 

(18) cudldiv}) = 0 and a;({W e TPiv : W|[„] Id[„]}) < 00 for every n € N, 

with Idy denoting the identity Qv &v, P G N. 

We construct each Fg^^ through its finite restrictions F^'^ := (Fj^”^)f>o on Q[n\ by first 
putting Fq := G|[„] and then defining 

, , • F*^”^ := if f > 0 is an atom time of W for which V\lt\{n] Id[„], or 

• F*^”^ := Tff\ ofherwise. 

Above, we have written F*J”^ := lirngp F*^”^ to denote the state of Fg”^ in the instant before 
time f > 0 . 

By (flSll . every F^”^^ has cadlag paths and is a Markov chain on . Moreover, if co is 
exchangeable, then so is F^"^. By construction, is the restriction to of for 
every m < n and every G e ^]n. In particular, Fg”^ = Pg”L ^ such that 

G|[„] = G'|[„]. Thus, (Fg”J^),;g]N determines a unique collection F^ ^ = (Fpt>o in for every 

G e We define the process F^ = {F^ ^ : G e as the family of all such collections 
generated from the same Poisson point process. 

Theorem 3.3 (Poissonian construction). Let F = {Fg : G € be an exchangeable Feller 
process on ^jn. Then there exists an exchangeable measure co satisfying tflSl) such that F =£ F^, as 
constructed in GH). 
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3.2.1. Levy-ltd representation. Our next theorem builds on Theorem 13.31 by classifying the 
discontinuities of T into three types. If s > 0 is a discontinuity time for Tg = (rf)f>o, then 
either 

(I) there is a unique edge ij for which + T‘J , 

(II) there is a unique vertex i > 1 for which the edge statuses are updated 

according to an exchangeable transition probability on {0,1}'’^ and all edges not 
incident to i remain fixed, or 

(III) the edges of Tg- are updated according to a random rewiring map as in discrete-time. 

Qualitatively, the above description separates the jumps of Tg according to their local and 
global characteristics. Type (I) discontinuities are local—they involve a change in status 
to just a single edge—while Type (III) discontinuities are global—they involve a change to 
a positive proportion of all edges. Type (II) discontinuities lie in between—they involve 
a change to infinitely many but a zero limiting proportion of edges. According to this 
characterization, there can be no discontinuities affecting the status of more than one but a 
zero limiting fraction of vertices or more than one but a zero limiting fraction of edges. 

The decomposition of the discontinuities into Types (I)-(III) prompts the Levy-ltd decom¬ 
position of the intensity measure co from Theorem l3.3l More specifically, Theorem l3.4l below 
decomposes the jump measure of co into a unique quadruple (e, v, S, T), where e = (eg, ei) 
is a unique pair of non-negative constants, v is a unique non-negative constant, Z, is a 
unique probability measure on the space of 2 X 2 stochastic matrices, and T is a unique 
measure on the space of rewiring limits. These components contribute to the behavior of 
Tg/ G 6 ^]N, as follows. 

(I) For unique constants eo, ei > 0, each edge ij, i j, changes its status independently 
of all others: each edge in Tg is removed independently at Exponential rate eo > 0 
and each absent edge in Tg is added independently at Exponential rate ei > 0. A 
jump of this kind results in a Type (I) discontinuity. 

(II) Each vertex jumps independently at Exponential rate v > 0. When vertex i e 
N experiences a jump, the statuses of edges ij, j + i, are updated conditionally 
independently according to a random transition probability matrix S generated 
from a unique probability measure Z on the space of 2 x 2 stochastic matrices: 

P{T'^’ = k' I T^^ = k,S} = Skk'. k, k' = 0,1, 

where S = {Skt) ~ Z. Edges that do not involve the specified vertex i stay fixed. A 
jump of this kind results in a Type (II) discontinuity. 

(Ill) A unique measure T on 'V* determines a transition rate measure Qr, akin to the 
induced transition probability measure llT4ll discussed in Section I3.I.II A jump of 
this kind results in a Type (III) discontinuity. 

For i e N and any probability measure Z on 2 x 2 stochastic matrices, we write to 
denote the probability measure induced on 'TV'in by the procedure applied to vertex i in 
(II) above. That is, we generate W ~ by first taking S ~ Z and, given S, generating 
W’} = Wl), j ^ i, as independent and identically distributed from 

P{ Wq = k I S} = Sgk, k = 0,1 and j ^ i, and 
P{ Wj^ = k I S} = Sik, k = 0,1 and j t i. 
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For all other edges i'j', i' + f, such that i i {V, /'}, we put W‘'i' = (0,1). Thus, the action of 

W ~ on G € ^]N results in a discontinuity of Type (11). By slight abuse of nofation, we 
write 

CO 

(20) Qe := Q®. 

i=l 

For k = 0,1, we define as the measure that assigns unit mass to each rewiring map with 
a single off-diagonal entry equal to (k, k) and all other off-diagonal entries ( 0 , 1 ). 

In the next theorem, I := | IdjN I denotes the rewiring limit of the identity IdjN : 'TF'n —> 
TTin and u;' is the mass assigned to Id[ 2 ] by Qi,, for any v 

Theorem 3.4 (Levy-lto representation). Let F^ = {F^^^ : G € be an exchangeable Feller 
process constructed in (fl^ based on intensity co satisfying (fl^ . Then there exist unique constants 
eo, ei, V > 0, fl unique probability measure Hon 2x2 stochastic matrices, and a unique measure T 
on 'V* satisfying 

(21) T({I}) = 0 and f (1 - yf^)T(du) < oo 

J'V- 

such that 


(22) oj — Qx + vQe + eoCo + 

Remark 3.5. By Theorem 13.31 every exchangeable Feller process F admits a construction by F^ in 
{T9 }i for some co satisfying (|T^ . Therefore, Theorem U^ provides a Levy-ltd-type representation for 
all exchangeable Qf^-valued Feller processes Y. 

Remark 3.6. The regularity condition (|2T]| and characterization (l22ll recall a similar description 
for "Ef-valued Levy processes, which decompose as the superposition of independent Brownian 
motion with drift, a compound Poisson process, and a pure-jump martingale. In the Poissonian 
component is characterized by a Levy measure fl satisfying 

(23) n({(0,..., 0)}) = 0 and J(1 A \x\^)n{dx) < oo; 

see Theorem 1 o/|j3|. Only a little imagination is needed to appreciate the resemblance between (|2T]| 
and (l23l) . 


Intuitively, l|2T]l is the naive condition needed to ensure that Qx satisfies (11^ . By the 
Aldous-Floover theorem (Theorem 14.21) . corresponds to the probability that a random 

rewiring map from restricts to Id[ 2 ] 6 'TF' 2 ; thus. 



(1 - v‘p)T{dv) < oo 


guarantees that the restriction of Y to ^[ 2 ] has cadlag sample paths. Under exchangeability, 
this is enough to guarantee that has cadlag paths for all n e IN. 


3.2.2. Projection into the space of graph limits. As in discrefe-fime, we write Y £>. for the process 
derived from F by mixing with respect to each initial distribution yD, D e IT. Analogous 
to Theorem l3.2[ every exchangeable Feller process almost surely projects to a Feller process 
in the space of graph limits. 
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Theorem 3.7 (Graph limit process). Let F = {Fg : G € be an exchangeable Letter process on 
Then |F£>• | exists almost surely and is a Fetter process on D*. Moreover, each |Fd| is continuous 
at all t > 0 except possibly at the times of Type (III) discontinuities. 

4. Preliminaries: Graph-valued processes 

Proof of our main theorems is spread over Sections |5] and HI In preparation, we first 
develop the machinery of exchangeable random graphs, graph-valued processes, rewiring 
maps, graph limits, and rewiring limits. 

4.1. Exchangeable random graphs. 

Definition 4.1 (Exchangeable random graphs). A random graph F € ffy Is exchangeable if 
F =£ for all o e Sy. A measure y on is exchangeable ify{S) = y{S°)for all o e Sy and 
all measurable subsets S c where S° := {G*^ : G e S}. 

In the following theorem, X is any Polish space. 

Theorem 4.2 (Aldous-Hoover ||2l. Theorem 14.21). Let X := {X^^)iy>i be a symmetric X- 
valued array for which X for all a € S^. Then there exists a measurable function 

f : [0,1]"^ —> X such that /(•, b, c, ■) = /(•, c, b, ■) and X =£ X*, where X* := {X*^t)iy>i is defined by 

(24) X-G=/(C 0 ,C|,-|,C(;},Cr;)), i,i>T 

for {Ca; (Ci;|)!>i; (C{;,;))/>!>i} id.d. Uniform random variables on [ 0 , 1 ]. 

By taking X = {0,1}, the Aldous-Hoover theorem provides a general construction for 
all exchangeable random graphs with countably many vertices. We make repeated use 
of the representation in throughout our discussion, with particular emphasis on the 
especially nice Aldous-Hoover representation and other special properties of the Erdos- 
Renyi process. 

4.2. Erdos-Renyi random graphs. For fixed p e [0,1], the Erdds-Renyi measure Cp on is 
defined as the distribution of P € obtained by including each edge independently with 
probability p. The Erdos-Renyi measure is exchangeable for every p e [0,1]. We call T ~ Sp 
an Erdos-Renyi process with parameter p. 

By including each edge independently with probability p, the finite-dimensional distri¬ 
butions of F ~ £p satisfy 

(25) P{r|[„] = F} = 4")(f) := Yl p^"(l-p)i-^">0, neN. 

l<i<j<n 

Thus, Cp has full support in the sense that it assigns positive measure to all open subsets of 

Important to our proof of Theorems 13.1113.41 and 15.11 T ~ £p admits an Aldous-Hoover 
representation T =£{goiC<ii, Q{i], Cj/p L.[i,j]))i,j>i, where 


( 26 ) 


go(C0,C{/pC(;),Ci/,;}) - g'oiCyj]) ■ 


1, 0 < C{;,;) < p, 

0 , otherwise. 
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4.3. Feller processes. Let Z := {Z^ : z 6 be a Markov process in any Polish space 2^. 
The semigroup {Ft)teT of Z acts on bounded, measurable functions g : —> K by 

Ftg{z) := lE{g{Zt) I To = z), z e Z- 

We say that Z possesses the Feller property if for all bounded, continuous > K 

(i) z i-> Ftg{z) is continuous for every f > 0 and 

(ii) lim^o Ftgiz) = g{z) for all z e Z- 

Proposition 4.3. The following are equivalent for any exchangeable Markov process F = {Fg : 
G € ^]n} on ^]N. 

(i) F is consistent. 

(ii) F has the Feller property. 

Proof. (i):^(ii): Compactness of the topology induced by (l6]l and the Stone-Weierstrass 
theorem imply that 

^ K : 3n e N such that G|[„] = G'|[„] implies g{G) = g^(G')} 

is dense in the space of continuous functions R. Therefore, every bounded, continu¬ 
ous g : ^ N can be approximated to arbitrary accuracy by a function that depends on 

G € only through G|[„], for some n € N. For any such approximation, the conditional 
expectation in the definition of the Feller property depends only on the restriction of F to 
^[„], which is a Markov chain. The first point in the Feller property follows immediately 
and the second follows soon after by noting that 0[„] is a finite state space and, therefore, 
F^”] must have a strictly positive hold time in its initial state with probability one. 

(ii)=^(i): For fixed n e N and F e Q[„], we define —> {0,1} by 

i/'f(G) := 1{G|[„] = f}, G e 

which is bounded and continuous on To establish consistency, we must prove that 
IP{rt|[n] = F I To = G} = P{Tt|[„] = F I ro|[„] = G|[„]} 
for every t > 0, G e and F e ^[„], for all n € N, which amounts to showing that 
(27) PtipF(G) = PtMGl 

for all G, G* e for which G|[„] = G*\[n]- 

By part (i) of the Feller property, Pfi/'F(-) is continuous and, therefore, it is enough 
to establish (l27l) on a dense subset of {G € : G|[„] = F}. Exchangeability implies that 

Pti/'f(G) = Pt4’F{G°) for alio € Sjn that coincide with the identity [n] ^ [n]. To establish ((27)l . 
we identify G* e such that G’‘|[„] = F and {G*‘^ : a coincides with the identity [n] ^ [n]} 
is dense in {G e : G|[„] = F}. 

For this, we draw G* ~ £ 1/2 conditional on the event {G*|[„] = F). Now, for every 
F' £ n' > n, such that F'|[„] = F, Kolmogorov's zero-one law guarantees a permutation 
a : N ^ N that fixes [n] and for which G*°\\n'] = F'. Therefore, 

{G**^ : a e S]n, a coincides with identity [n] —> [n]} 

is dense in {G e : G|[„] = F}. By the invariance of Ptf’Fi') with respect to permutations 
that fix [n], Pfi/'F is constant on a dense subset of {G e : G|[„] = F}. Continuity implies 
that Ptf’Fi') must be constant on the closure of this set and, therefore, can depend only on 
the restriction to ^[„]. 
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By part (ii) of the Feller property, 

VtipFiC*) as t J, 0. 

It follows that each finite restriction F^"] has cadlag paths and is consistent. □ 

4.4. More on graph limits. Recall Definition 12.31 of dissociated random graphs. In this 
context, D* corresponds to the space of exchangeable, dissociated probability measures on 
^]N, so we often conflate the two notions and write 

D(f) := yoClG e : G|[„] = F}), F e n eN, 

for each D e D*. The space of graph limits D* corresponds to the set of exchangeable, 
dissociated probability measures on and is compact under metric 

(28) ||D - D'll := 2-" D' e D*. 

neN Fe0[„] 

We furnish D* with the trace of the Borel cr-field on [0, l]UmeiN 0im] 

The Aldous-FIoover theorem (Theorem l4.2l) provides the link between dissociated mea¬ 
sures and exchangeable random graphs. In particular, dissociated graphs are ergodic with 
respect to the action of Sjn in the space of exchangeable random graphs, i.e., the law of 
every exchangeable random graph is a mixture of dissociated random graphs, and to every 
exchangeable random graph T there is a unique probability measure A so that F ~ yA as in 

Cl]). 

Example 4.4 (Graph limit of the Erdos-Renyi process). For fixed p € [0,1], let (£^"')neN be 
the collection of finite-dimensional Erdos-Renyi measures in (l25l) . The graph limit |F| o/F ~ £p is 
deterministic and satisfies 6(F,F) = £p”^ a.s.for every F e ^[„], n e N. 

Example 4.5 (Random graph limit). In general, the graph limit of an exchangeable random graph 
F is a random element ofD*. For example, let be the mixture of Erdos-Renyi measures by the 
Beta distribution with parameter {a,f), i.e., 

■= I ep{-)^a,i}{dp), 

d[o,i] 

where denotes the Beta distribution with parameter (a, jS). The finite-dimensional distributions 
o/F ~ ea,ii are 

(29) P{r|[„] = Fj = £^”) (F) :=-F€^[„], n € N, 

{a + /)Thl 

where ni := T,i<i<j<n Ml] ^ «o := Li<;<;<n Mf i F}, and ah := a{a + l)---{a + j-l). In this 
case, F ~ ea,^ projects to a random element |F| of D*, where |F| is distributed over the graph limits 
of Ep-distributed random graphs for p following the Beta distribution with parameter (a,/). 

Remark 4.6 (Connection to Lovasz-Szegedy graph limit theory). Lovdsz and Szegedy 1911 
define a graph limit in terms of a measurable function cj): [0,1] x [0,1] ^ [0,1], called a graphon. 
To see the connection to our definition as an exchangeable, dissociated probability measure, we can 
generate a random graph F by first taking Ui,U 2 ,... i.i.d. Uniform random variables on [0,1]. 
Conditional on Ui, U 2 ,. ■., we generate each independently according to 

FiUi = l\ Ui,U2,...} = (P{Ui,Uj), i<j. 
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The distribution ofT corresponds to yjofor some D e D*. 

Some comments about the Lovdsz-Szegedy notion of graph limit. 

(1) For a given sequence of graphs {G„)neK, Lovdsz and Szegedy's graphon (|f9|. Section 1) 
is not unique. In contrast, our interpretation of a graph limit as a probability measure is 
essentially unique (up to sets of measure zero). 

(2) Lovdsz and Szegedy's definition of graphon is a recasting of the Aldous-Hoover theorem in 
the special case of countable graphs; see Theorem \4)2\ above. 

(3) Our definition of a countable graph G e as the projective limit of a compatible 
sequence of finite graphs (G„)„g]N should not be confused with a graph limit. Any G € 
corresponds to a unique compatible sequence (Gi, Gz, ■ ■ ■) of finite graphs, whereas a graph 
limit D e D* corresponds to the measurable set of countable graphs |D|“^ := {G e : 
|G| = D). 

4.5. Rewiring maps and their limits. As defined in Section 13.11 a rewiring map W is a 
symmetric {0,1} X jO, l}-valued array (W'0;,y>i with (0,0) along the diagonal. We often 
regard W as a map —> Qk, a pair (Wq, Wi) e x or a jO, 1} x (0,1 {-valued array, 

without explicit specification. 

Given any W € AV[„] and any injection : [m] —> [n], we define W'^’ := In 

particular, W|[„] := {Wo|[„], Wi|[„]) denotes the restriction of W to a rewiring map Q[„] ^[„] 

and, for any a e Sjvj, is the image of W under relabeling by a. We equip W'n with the 
product-discrete topology induced by 

d(W, W') := 1/ maxjn e N : W|[„] = W'|[„]}, W, W' € AV^, 

and the associated Borel a-field o{ •|[M])neN generated by restriction maps. 

Definition 4.7 (Exchangeable rewiring maps). A random rewiring map W e "Wn is exchange¬ 
able ifW=£ for all o € S^. A measure co on "Win is exchangeable if 

co{S) = co{S‘^) for all a e S^, 

for every measurable subset S c AV^.^, where S° := jW^ : W € S}. In particular, a probability 
measure co on "Win is exchangeable if it determines the law of an exchangeable random rewiring 
map. 

Appealing to the notion of graph limits, we define the density ofVe AV[m\ in W € AV\n\ 
by 

b{V, W) := ind(y, Wjjn^"^, 

where, as in ind(y, W) is the number of injections (p : [m] —> [n] for which W'^’ = V. We 
define the limiting density ofVe AV[m] in W 6 W'n by 

6(V, W) := lim 6{V, W|r,;]), if it exists. 

n—>oo 

Definition 4.8 (Rewiring limits). The rewiring limit ofWe AV^ is the collection 

provided b(V, W) exists for every V € Umeix ff 5(V) W) does not exist for some V, then we 

put |W| := d. We write W'* to denote the closure o/{|W| : W € "WinI \ {d} in [0, l]UmeN'tV[m]_ 

Following the program of Section 12.21 every v e 'V* determines an exchangeable prob¬ 
ability measure Qt, on W'n. We call the rewiring measure directed by v, which is the 
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essentially unique exchangeable measure on such that Q^-almost every W e has 
|W| = u. Given any measure T on 'V*, we define the mixture of rewiring measures by 

(30) Ot(-):= r ^v{-)T{dv). 

J'V' 

The space of rewiring limits 'V* corresponds to the closure of exchangeable, dissociated 
probability measures on and, therefore, is compact under the analogous metric to (l28l) . 

||y - y'll ;= 2-" \viV) - v'{¥)], U, u' € TG 

neN VenV[„] 

As for the space of graph limits, we furnish 'Y* with the trace Borel a-field of [0, l]UmeN ^[mi. 

Lemma 4.9. The following hold for general rewiring maps. 

(i) As a map —> ^]n, every VJ € is Lipschitz continuous with Lipschitz constant 1 
and the rewiring operation is associative in the sense that 

(W o W) o W" = W o (W' o W"), for all W, W', W € TVn ■ 

(ii) (^(0))“^ = W{G^)for all W € TVn, G 6 Qn, and o e S^. 

(iii) IfWe TT'in is an exchangeable rewiring map, then |W| exists almost surely. Moreover, for 
every v e 'V*, O^j-almost every VJ e TTin has |W| = v. 

Proof. Parts (i) and (ii) are immediate from the definition of rewiring. Part (iii) follows from 
a straightforward modification of the almost sure existence of |r| for any exchangeable 
random graph P, cf. Theorem l4.2[ □ 

5. Discrete-time chains and the rewiring measure 

5.1. Conditional Aldous-Hoover theorem for graphs. 

Theorem 5.1 (Conditional Aldous-Hoover theorem for graphs). Let T be an exchangeable 
Feller chain on whose transitions are governed by transition probability measure P. Then there 
exists a measurable function f : [0,1]"^ x {0,1} —> {0,1} satisfying /(•, b, c, ■, •) = /(•, c, b, ■, •) such 
that, for every fixed G e the distribution ofT' ~ P(G, •) is identical to that ofT'* := (r'*'^);,;>i, 
where 

(31) = m, C(I), Ci;P G% i, j > 1, 
for {Ca; (C{;|)!>i; (C{;,;));>!>i} id.d. Uniform random variables on [0,1]. 

The representation in (IMl) requires a delicate argument. By the implication (ii)=>(i) 
in Proposition 14.31 we can immediately deduce a weaker representation for T' by T'’" = 
with 

= /(Ca, Cj,), G|[,v;]), i, i > 1, 

where i ^ j ■= max{i,j). The stronger representation in jMl) says that the conditional 
distribution of each entry of T'* depends only on the corresponding entry of G. 

Proof of Theorem \5?I\ Let P = {Tg : G € be an exchangeable Feller chain on with 
transition probability measure P. Let £1/2 denote the Erdos-Renyi measure with p = 1/2. 
To prove d^ , we generate a jointly exchangeable pair (T, T'), where 

T ~ £1/2 and T' | T = G ~ P(G, •)• 
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By exchangeability of £1/2 and the transition probability measure P, (F, F') is jointly ex¬ 
changeable, i.e., (F'^, F'‘^) =x(F, F') for all o e S]n, and, therefore, determines a weakly 
exchangeable {0,1| x {0, l}-valued array. By the Aldous-Hoover theorem, there exists a 
measurable function / : [0,1]“^ ^ {0,1} X {0,1} such that (F, F') =x(F*, F'’"), where 

(r,r7' = /(C0,4pC(;i,CR;i), i,i>h 

for {Ce; (C(!i)!>i; (C|/,/));>!>i} i-i.d. Uniform[0,l]. By separating components, we can write 
/ = (/o,/i)sothat 

(r.7,F-;) = (/o(C0,Ci,pC(;>CR;l)Jl(C0,C(,pC|;pC(^ hi > 1. 

With go and g'^ defined as in (l26ll , we have 

(goiCoXjii, ~ £1/2 

and 

(/o(C0/ C(!l, C|;)/ Cii,jj)kj>l =£(go(C 0 , Cjij, Cjjjr Qi,jl)kj>l = (go(QiJlkj>l- 
Using Kallenberg's notation [7], we write Cj = iQi)icj for subsets / c N, so that C{i,j] = 
(C0,C(!pC(y),C|!,/)), hi > 1, and C{i] = i > 1- By Fheorem 7.28 of 13, there exists a 

measurable function h : [0,1]^ U [0,1]^ U [0,1]^ —> [0,1] such that for {)]0; (r]j,|);>i; (j](!,;i)y>i>i} 
i.i.d. Uniform[0,1] random variables, l2(C/, ?]/) ~ Uniform[0,1] and is independent of C/\{C/} 
and fjjWTlj} for every / c IN with two or fewer elements and 

^o(Qui) = goiCu,!]) = foQim, m), a.s. for every i, j > 1. 

Now,put <^0 = h{l,o,rio)r^[i\ = and = /i(U7,%j))sothat{^0;(<^j,));>i;(<^ly))y>;>i} 

are i.i.d. Uniform[0,1] random variables. The generic Aldous-Hoover representation al¬ 
lows us to construct (F*, F'’") by 

(PU p/U) = i,i > 1. 

From Kallenberg's Theorem 7.28, (F*, F'*) also has the representation 

(r'V,r-/) = (/o(||,y}),/i(|(,•,;•))) = (go(C(/,;l),^i(C(yl,l]iyl)), a.s., i,j > 1, 

where gi : [0,1]® ^ {0,1} is the composition of /i with h. Again by the Coding Lemma, we 
can represent (Ci/,;vi]j;,;i)!,;>i by 

(Qi/i' ^]|!,/i)i;>l ~£('^(^|!,7)))i;>l/ 

where {a©; (a|,));>i; («|;,;j);>;>il are i.i.d. Uniform[0,1]. 

It follows that (F, F') possesses a joint representation by 

(32) F*'^' = g'oianj]) and 

By the Coding Lemma, we can represent 

for (T(!,/i)y>!>i Fi-d- Uniform[0,1] random variables independent of (n(;,y));>;>i. Thus, we 
define 

g[ia0 ,«{,), a{j],X{i,j], G'f) := giiao ,«{;[, ajy|, u{G^>,X{i,j])) =£ S'i(«0/«{,),«{;),«{;,/}), 
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SO that 

(r, r) =^(g'(ajyi), g;(a 0 , aij], a(,-,y|, go{a^^j])))i,j>i. 

Conditioning on {F = G} gives 

P(G, •) = W{{g[{aq„ a{i], aij], G‘>))i^j>i e ■] for ei/2-almost every G 6 . 

By the Feller property, P(G, ■) is continuous in the first argument and, thus, the above 
equality holds for all G 6 and representation follows. □ 

5.2. Discrete-time characterization. The above construction of F from the single process 
F^ is closely tied to the even stronger representation in Theorem l3.ll according to which F 
can be constructed from a single i.i.d. sequence of exchangeable rewiring maps. 

Proposition 5.2. For an exchangeable probability measure co on 'TF'in, let F^ = {F^^ : G e 
be constructed as in dl^ from an i.i.d. sequence Wi, W2,.. .from co. Then F^ is an exchangeable 
Feller chain on 

Proof. By our assumption that Wi, W2 ,... are independent and identically distributed, each 
Fg has the Markov property. Exchangeability of co and Lemma lT^ ii) pass exchangeability 
along to F^. By Lemma l4.9f i), every W € 'TF'n is Lipschitz continuous with Lipschitz 
constant 1, and so each F^”^^ also has the Markov property for every n € N. By Proposition 
14.31 F^ is Feller and the proof is complete. □ 

Definition 5.3 (Rewiring Markov chains). We call F^ constructed as in dl^ a rewiring chain 
with rewiring measure co. If co = Qy/or some probability measure T on 'V*, we call F^ a rewiring 
chain directed by T. 

Theorem 5.4. Let F be an exchangeable Feller chain on Then there exists an exchangeable 
probability measure co on so that F =£ F^, where F^ = {F^ ^ : G e is a rewiring Markov 
chain with rewiring measure co. 

Proof. By Theorem 15.11 there exists a measurable function / : [0,1]"^ x {0,1} ^ {0,1} so that 
the transitions of F can be constructed as in d^ . From /, we define f* : [0,1]“^ ^ {0, Vf by 

f*{a, b, c,d):= {f{a, b, c, d, 0), f{a, b, c, d, 1)). 

Given i.i.d. Uniform[0,1] random variables {C0; (C{;));>i; (C|!,;));>!>iIa we construct a weakly 
exchangeable {0, l}^-valued array W* := {W*'^)i,]>\ by 

W-G=f(C0,Cj,),C(y,,C|yi), i,7>l. 

We write co to denote the essentially unique distribution of W*. 

Treating W* as a rewiring map, the image W*(G) = F* satisfies 

F^'V = /(C0, C(,), C|;1, G'>) for all i, j > 1, 

for every G € ^]n; whence, F)^ in dl^ has the correct transition probabilities. 

The proof is complete. 


□ 
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5.3. Characterizing the rewiring measure. Theorem 15.41 asserts that any exchangeable 
Feller chain on can be constructed as a rewiring chain. In the discussion surrounding 
Lemma 14.91 above, we identify every exchangeable probability measure (o with a unique 
probability measure T on 'V through the relation co = Qy, with Qy defined in (l30ll . Our 
next proposition records this fact. 

Proposition 5.5. Let co he an exchangeable probability measure on 'W-^. Then there exists an 
essentially unique probability measure T on 'V* such that co = Qy := Q,T(du). 

Proof. This is a combination of the Aldous-Hoover theorem and Lemma lT^ iii). By Lemma 
l4.9f iiiL cu-almost every W 6 TLin possesses a rewiring limit, from which the change of 
variables formula gives 

co{dW) := I Div\{dW)co{dV) = f Q^(dW)l(ol(dv) = Q|^|(dW), 

JaViN 

where \co\ denotes the image measure of a; by | • | : 'TF'n ^ 'V* U{5}. □ 

Proof of Theorem l3J] Follows from Theorem lS^ and Proposition l5.5[ □ 

5.4. The induced chain on D*. Any v e 'V* corresponds to a unique transition probability 

Py on as defined in (ll^ . Moreover, v e ’V* acts on D* by composition of 

probability measures, as in (fT^ . For v, v' 6 'V*, we define the product P' = PvPv’ by 

(33) P'{G,dG'):= r P^fG",dG')P^{G,dG"f G,G'e^N. 

Lemma 5.6. Let W, W' 6 ‘TF'jn be independent exchangeable random rewiring maps such that |W| 
and |W'| exist almost surely. Then |W' o W| exists almost surely and 

-P|W'oW| = P\W\P\W'\ «-S. 

Proof. Follows by independence of W and W', the definition of W' o W, and the definition 
of F|w|f’|W'| in (I33ll . □ 

Proof of Theorem l372l By Theorem 13.11 there exists a measure T on 'V* such that we can 
regard F as F^, the rewiring chain directed by Y. Thus, for every G € ^]n, Fg = (Fm)m>o is 
determined by Tq = G and 

Tm =j:(Wnr o • • • o Wi)(G), m > 1 , 

where Wj, W2 ,... are i.i.d. with distribution Qy. 

For any D e D*, F^ = (T„j)m>o is generated from F = {Fg : G e by first taking 
Fq ~ 7d and then putting F^ = F^ on the event Fq = G. By the Aldous-Hoover theorem 
along with exchangeability of yo and Qy, the graph limit |Fm| exists almost surely for every 
m > 0 and, thus, |Fd| := (|T„j|)m>o exists almost surely in !D*. 

Also, by Lemma lA^ iii) , \VJ\\, IW2I, ... is i.i.d. from T, and, by Lemma |5^ |o • • • o Wi| 
exists almost surely and 

^’|w„,o...oWi| = P\Wi\ ■ ■ ■ P\w^\ a.s. for every m>l. 

Finally, by Theorem 13.11 

\Pm\ =£ ny^m 0---0 Wi)(Fo)| = |Fo||Wi| • • • \Wm\ a.s. for every m>l, 
and so each |Fd| is a Markov chain on D* with initial state D and representation (llTl) . 
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To establish the Feller property, we use the fact that D* is compact and, therefore, any 
continuous function h : D* —> R is uniformly continuous and bounded. The dominated 
convergence theorem and Lipschitz continuity of fhe action of u 6 'V on D* immediately 
give part (i) of the Feller property Part (ii) of the Feller property is trivial because | F^). | is 
a discrete-time Markov chain. □ 


We could interpret P' in ll33ll as the two-step transition probability measure for a time- 
inhomogeneous Markov chain on with first step governed by Py and second step 
governed by P,/. By this interpretation. Theorem 13.21 leads to another description of 
any exchangeable Feller chain F as a mixture of time-inhomogeneous Markov chains. In 
particular, we can construct F by first sampling Yi, Y 2 , ■ ■ ■ i.i.d. from the unique directing 
measure T. Each Y, induces an exchangeable transition probability Py^ as in l|T4)l . At each 
time m > 1 , given Fm-i,... ,Fo and Yi,Y 2 ,..., we generate F^ ~ Py^(F,„-i, •)■ 


5.5. Examples. 


Example 5.7 (Product Erdos-Renyi chains). Let (po, Pi) 6 (0,1) x (0,1) and put co = £pg<E> e^j, 
where £p denotes the Erdos-Renyi measure with parameter p. This measure generates transitions 
out of state G e ^]n by flipping a pi-coin with k = G'-' independently for every j > i > 1. The 
limiting trajectory in D* is deterministic and settles down to degenerate stationary distribution at 
the graph limit of an Cq-random graph, with q := po/(l - pi + po)- 


Example 5.8 (A reversible family of Markov chains). The model in Example\5J\generalizes by 
mixing (po,pi) v^ith respect to any measure on [0,1] x [0,1]. For example, let a,f^ > 0 and define 
CO = epg^ £Pj for (Po, Pi) ~ ^ where is the Beta distribution with parameter (a, j6). 

The finite-dimensional transition probabilities of this mixture model are 


PIPM ^ = F 


M _ al'"oOj6T«oi|gTnioctT«ii 


F,F' e Q[n], 


where Urs := L 1 <;<;<« = h P"^ = s} and nr, := n,.o -t n^i, r = 

probabilities are reversible with respect to 


P{fW = P} 


(a + j6)^”o(a + 

(2a + 


F £ &[n], 


0 , 1 . 


These transition 


where ny := Li<;<;<n MF'> = r},for r = 0 , 1 . 


6. Continuous-time processes and the Levy-Ito measure 

We now let F := {Fg : G 6 be a continuous-time exchangeable Feller process on 
Any such process can jump infinitely often in arbitrarily small time intervals; however, by 
the consistency property (HI, every finite restriction F^”] is a finite-state space Markov chain 
and can jump only finitely often in bounded intervals. As we show, the interplay between 
these possibilities restricts the behavior of F in a precise way. 

As before, Id]N stands for the identity map —> ^in- Let co be an exchangeable measure 

on 'TV'n that satisfies 

(34) a)({Id]N}) = 0 and (u({W 6 'TV'in : Wjpj Idpj}) < 00 . 

We proceed as in (fl^ and consfruct a process F^ := {F^ ^ : G e on from a Poisson 
point process W = {{t, Wf)} c R+ x TPin with intensity dt ® co. 
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Proposition 6.1. Let co be an exchangeable measure satisfying ll34l) . Then constructed in ([T9ll 
is an exchangeable Feller process on 

Proof. For each n e IN, is the restriction of to a process on Q[„]. By construction, 
is a compatible collection of Markov processes and, thus, determines a process 
on ^]N. By exchangeability of co and ([Mil . 


co{{We^^: = 


< 


< 


( 


CO 




\ 


l<i<i<n 


^^^t^com e : W|[2] t Id[2]|) 

oo. 


so that CO satisfies (fl^ . Also by exchangeability of co, each is an exchangeable Markov 
chain on @\n\ ■ The limiting process FJ^ is an exchangeable Feller process on by Proposi- 
tion|431 □ 


Corollary 6.2. Every exchangeable measure co satisfying dMl) determines the jump rates of an 
exchangeable Feller process on 

By the Feller property, the transition law of each finite restriction F^"^ is determined by 
the infinitesimal jump rates 

(35) Q„(f,r):=limip{FM=r |rM=F}, F,F'eQ[„p F ^ F. 

40 f ^ 

Exchangeability @ and consistency (|1]| of F imply 

(36) Qn(F‘^,F'‘’) = Qn(F,F') for all permutations a : [n] —> [n] and 

(37) Qm(Fkmpn = Qn(F,{F" F'%]=n)= Y 


for all F 6 and F' € such that F|[,„] +F' ,m< n. Thus, for every G e (Qn)neN 
determines a pre-measure Q(G, •) on ^]n \{G} by 

Q(G,{G' e : G\„] = F'}) := Q.(G|m,F'), F' e \{G|m}, n e N. 

By (j37ll . Q(G, •) is additive. By Caratheodory's extension theorem, Q(G, ■) has a unique 
extension to a measure on \{G}. 

In F^ constructed above, oj determines the jump rates through 


Q(G, •) = com 6 TPn : W(G) e •}), G e \{G}. 


In fact, we can show that the infinitesimal rates of any exchangeable Feller process are 
determined by an exchangeable measure co that satisfies dMl) . Our main theorem (Theorem 
13.41) gives a Levy-Ito representation of this jump measure. 
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6.1. Existence of an exchangeable jump measure. Let (Pt)t>o be the Markov semigroup of 
an exchangeable Feller process r on ^]N. For every f > 0. Theorems l5.1l and l5.4l guarantee the 
existence of an exchangeable probability measure cof on such that, for every G € 

(38) cotm 6 : W(G) e •!) = P{Ff € ■ | Fq = G}. 


By the relationship between (cot)t>o and the time-homogeneous Markov process (rt)t>o, cot is 
exchangeable for every t > 0, and the Chapman-Kolmogorov theorem implies that {cot)t>o 
satisfies 

(39) cot+siiW e : W(G) 6 •}) = ( e : (W' o W)(G) e ■})a)s{dW), 

for all s, f > 0 and all G e The family {a)t)t>o is not determined by these conditions, 
but time-homogeneity and (l38ll allows us to choose a family (cot)t>o that satisfies the further 
semigroup property 

cot+sO) = f e nVN : W' O W e ■])ojs{dW), s, f > 0. 

d'W'lN 

By the Feller property, Wf ~ cot must also satisfy 

Pt^(G) = Eg(Wf(G)) ^ g(G) as f i 0 for all G € Qn, 


for all continuous g : ^ R. Thus, as 1 J, 0, YJt —^p Idiv and cot —>w b{id]Nir the point 

mass at the identity map. (Flere, -^p denotes convergence in probability and -^zu denotes 
weak convergence of probability measures.) By right-continuity at i = 0, we have a family 
((Uf)f>o of measures on TVin. 

We obtain an infinitesimal jump measure co on 'TV'in \{Id]N} through its finite-dimensional 
restrictions on 'W[„] \{Id[„]}: 

(40) = V nelN. 


Proposition 6.3. The family of measures ((y^”^)ng]N in diOll determines a unique exchangeable 
measure co that satisfies dMl) . 

Proof The Borel cr-field a ^UneN is generated by the 7z-system of events 

{W 6 TPn : W|[„] = n n e N. 

For every n e N and V e 'W[n], we define 

com e nV]N : W|[„] = L}) = 

By construction, ((y^”^),;eN is consistent and satisfies 

^(m)(y) ^ 

for every m <n and V e '3T'[„,] \ {Id^}. Therefore, the function a)({W e 'TV'in : W|[„,] = 1/}) = 
is additive and Caratheodory's extension theorem guarantees a unique extension 
to a measure on TVin \{Id]N}. 

For each n e IN, determines the jump rates of an exchangeable Markov chain on 
and so \{Id[„]}) < oo for all n 6 N. Specifying (y({Id]N}) = 0 gives (l34ll . 

Exchangeability of every cot, t > 0, makes each n e IN, exchangeable and, hence, 
implies co is exchangeable. □ 
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Theorem 13.31 (Poissonian construction). Let P = IPq : G € be an exchangeable Feller 
process on Then there exists an exchangeable measure co satisfying (|l8l) such that T =£ as 
constructed in m- 

Proof. Let co be the exchangeable measure from Proposition 16.31 and let W = {{t, Wj)} be a 
Poisson point process with intensity dt (g) co. Since co satisfies dMl) . Proposition l6.1l allows us 
to construct P^ from W as in (fl^ . The jump rates of each P^^”^ are determined by a thinned 
version of W that only maintains the atoms (f, INf) for which Wt|[„] Id[„]. By the 

thinning property of Poisson random measures (e.g. [16]), the intensity of is co^^\ as 
defined in diOl) , and it follows immediately that the jump rate from F to F' ^ F in P^”^ is 

e : W(F) = F'}) = Qn(F,F'), 

for Qn(-, •) in (l35l) . Furthermore, 

Qn{F,&[„] \{f}) = co^"\{W € : W(F) ^ f}) < CX, 

for all F e Q[„], n e IN. By construction, is a compatible collection of cadlag 

exchangeable Markov chains governed by the finite-dimensional transition law of P. The 
proof is complete. □ 

6.1.1. Standard co-process. For co satisfying (fl^ , we define the standard co-process := 
(wp t>o on TVin as the 'TF'iN-valued Markov process with W* = Idisj and infinitesimal jump 
rates 

QiW,dW') := co{{W' e "VPn : W" o W e dW}), WtWe . 

Associativity of the rewiring maps (Lemma l4.9f ill makes W = {Wy : V e TL'inI a consistent 
Markov process, where Wy := {W* o V)t>Q for each V e Thus, an alternative descrip¬ 
tion to the construction of P^ = {Pq,^ : G € in (fl^ is to put Pg^ = {P^*t{G))t>Q, where 
w;, is a standard cu-process. 

Corollary 6.4. Let P = {Pg : G € he an exchangeable Feller process on Then there exists 
an exchangeable measure co satisfying dlSl) such that Pg =i;(Wj(G))f>o/or every G e where 
= (W*)t>o is a standard co-process. 

6.2. Levy-Ito representation. Our main theorem refines Theorem 13.31 with an explicit 
Levy-lto-type characterization of any exchangeable co satisfying jMl) . The representation 
entails a few special measures, which we now introduce. 


6.2.1. Single edge updates. For ; > i > 1 and k e {0,1}, we define 
G 1-^ G' = pI{G), where 


G'G' 


GG\ i']' + i] 
k, i'f = ij. 


by 


In words, G' = (G) coincides with G at every edge except {i ,;}: irrespective of G'/ p|/ puts 

G'^l = k. We call p^^ a single edge update map and define the single edge update measures by 


(41) 


£k(-)-= y k = 0,l, 

l<l<]<oo 


which place unit mass at each single edge update map 
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6.2.2. Single vertex updates. For any vertex i e N and G e the sequence of edges 
adjacent to i is an infinite {0, l}-valued sequence Let xq = x^x^ ■ ■ ■ and xi = x^x^ ■ ■ ■ 

be infinite sequences in {0,1} and let i e N be any distinguished vertex. For x = (xq, Xi) and 
i 6 N, we define by G' = vl.(G), where 


(42) 


G'i', 

i' + i and f + i 


/ 

0/ 

i' 

= i and G^'t' = 

0 

0 / 

r 

= i and G^'t' = 

0 , 

J 

X. , 

i' 

= i and G^'t' = 

1 

J' 

Xi, 

r 

= i and G^'t' = 

1 


We call a single vertex update map, as it affects only edges incident to the distinguished 
vertex i. 

When F is the realization of an exchangeable random graph, the sequence is 

exchangeable for all fixed z e IN. We ensure thaf the resulting F' = ^(.(F) is exchangeable by 
choosing x from an exchangeable probability distribution on pairs X = (Xo,Xi) of infinite 
binary sequences. Let Si denote the space of 2 x 2 sfochastic matrices equipped with the 
Borel a-field, i.e., each S e 52 is a matrix such that 

• Sii' > 0 for all i, i' = 0,1 and 

• Sio + S;i = 1 for i = 0 , 1 . 

Therefore, each row of S e 52 determines a probability measure on {0,1}. From a probability 
measure L on Si, we write W ~ to denote the probability measure of a random rewiring 

map W =£ v'^ consfrucfed by taking S ~ E and, given S, generating Xq and Xi independently 
of one another according to 


P{X^ = k I S} = Sok, k = 0,l and 
F{xi = k I Sj = Su, k = 0,l, 

independently for every j = 1,2,_We then define W = as in (l42l) . We define the single 

vertex update measure directed by E by 


(43) Qz(-):= J],0®(-). 

!=1 

For the reader's convenience, we restate Theorem l3.4l whose proof relies on Lemmas l6.5l 
16.61 and 16.71 from Section l63l below. 


Theorem 13.41 (Levy-lto representation). Let FJ^ = (Fg^ : G € be an exchangeable Feller 
process constructed in dT^ based on intensity co satisfying dTSl) . Then there exist unique constants 
eo, ei, V > 0, fl unique probability measure Honlxl stochastic matrices, and a unique measure Y 
on 'V* satisfying 

(44) T({I}) = 0 and f (1 - uf^)T(dj;) < oo 

J'V- 


such that 

(45) 


oj — Qx + vQ£ + eoCo + 
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6.3. Key lemmas. In the following three lemmas, we always assume that co is an exchange¬ 
able measure satisfying ([Mil . For n e IN, we define 

(46) 

as the restriction of oj to the event {W e 'dh'jN : W|[„] Id[„]}. While w can have infinite 

mass, the right-hand side of dMl) assures that is finite for all n >2. Exchangeability of co 
implies that co„ is invariant with respect to all finite permutations N —> N that fix [n]. Thus, 
we recover a finite, exchangeable measure from cOn by defining the n-shift of W = {W'^),j>i 
by W„ := and letting a7„ be the image of cOn by the n-shift, i.e., 

(47) &■,,(•) := coniiw 6 : K e •}). 


Lemma 6.5. Suppose co is exchangeable and satisfies dMll . Then co-almost every W 6 W'in 
possesses a rewiring limit |W|. 

Proof. Let cOn be the finite measure defined in (|4^ . The image measure in (l47ll is finite, 
exchangeable, and, therefore, proportional to an exchangeable probability measure on TF'in. 
By Lemma l4^ iii), a7„-almost every W 6 TF'in possesses a rewiring limit. Since the rewiring 

limit of W 6 'TF'in depends only on W„, for every n e N, we conclude that (U„-almost every 
W e TF'in possesses a rewiring limit. Finally, asn —> oo, 

(On T Cl’oo = Cdl(WeWiN: 

the restriction of co to {W 6 'TV'in : W Idj^}. By the left-hand side of (IMll . co assigns zero 
mass to {W 6 'TF'isi : W = Idisi}, and so cOoo = co. The monotone convergence theorem now 
implies that ca-almost every W 6 TViv possesses a rewiring limit. The proof is complete. □ 

Lemma 6.6. Suppose co is exchangeable, satisfies dMll , and co-almost every W 6 'TV'in has |W| 1. 

Then co = Clrfor some unique measure T satisfying (l44ll . 


Proof. Let cOn be as in (|4^ and for any measurable set A c "TVin let co„(- | A) denote the 

measure conditional on the event A. For fixed v e'V* and A,, := {W e 'TV'in : V\^nl[ 2 ] ^ Idpj}, 
COn satisfies 

COniAn\m=v) = S7„({W|[2] ^ Id[2]} I |W| = U) 

= Q,({W|[2] ^ Id[2]}) 


where is the component of u 6 'V* corresponding to Id[2]. By Lemma 1631 the image of 
COn by taking rewiring limits, denoted \cOn\, is well-defined and 

COniAn) = f (1 - vP)cOn(IWI e dv) = f (1 - vP)lcOnj(dv). 


By fhe monotone convergence theorem, \co„\ converges to a unique measure T := |(u| on 
'V*. Since cu-almost every W e 'TV'in has |W| I, this limiting measure satisfies T({I}) = 0. 
Moreover, 


r {1-V?^)\c0n\idv)'[ r (1- 
Jo/- 


vf'^)T{dv) 


and 


COniAn) < coiAn) = co{{YJ c TV'in : ^\[2] * Idp]}) < oo- 
Therefore, T satisfies (|4^ and Qt satisfies dMll . 
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We must still show that co = Qx. By Proposition l5.5[ we can write 


a)„{dW) 


-I 

J'V' 


Q.v{dW)\a)„\{dv), 


for each n 6 IN. By the monotone convergence theorem and exchangeability, 
lim S7,„({W : W|[„] = W) = a){{W : W|[„] = V]), 

m'[oo 

for every V e 'W[n] \{Id[„]}, n e N. Also, for every m > 1, 

^m({W : W|[„] = V})= f Q,({W : W|[„] = V})\tim\{dvl 

Jt* 

which increases to Qx({ W : W|[„] = V}) asm —> oo. By uniqueness of limits, Qx and co agree 
on a generating n-system of the Borel a-field and, therefore, they agree on all measurable 
subsets of 'W^. The proof is complete. □ 

Lemma 6.7. Suppose co is exchangeable, satisfies (l34l) , and co-almost every W 6 TVin has |W| = I. 
Then there exist unique constants eo, ei, v > 0 and a unique probability measure I, on S 2 such that 

CO = vQe + eoco + eiCi, 

where is defined in (|4T]l and Qe is defined in (|4^ . 

Proof. For any W e TVin, i £ N, and £, 6 > 0, we define 

n 

Lw{i) := lim sup n~^ ^ 1{W'^ (0,1)}, 

n^oc 

Sw{e) := {i 6 N : Lw{i) > e}, 

n 

|Sw(£)l := linasup n~^ ^ l{i e Sw(e)}, and 

n^co 

y(£,6):={W6TV]N: |Sw(e)l > 6}- 
We can partition the event {W e TVin : | W| = 1} by V U E, where 


V := 0{W 6 : Lw(i) > 0} and 

i=l 

00 

E := QlW 6 : Lw(i) = 0}. 


i=i 


Thus, we can decompose co as the sum of singular measures 

CO = COy + COe, 

where coy and coe are the restrictions of cc to V and £, respectively. As in ll4^ . we write 

tay.fj := tavljWeWiN:W|[„];tid[„]) and 
(OE,n ■= a^El|WeaVN:W|[„];tId[„]) 

to denote the restrictions of ca to V n {W 6 'TV'n : W|[„] Id[„]} and E n {W 6 TFisi : W|[„] 

Id[„]}, respectively. By dMll , both coy^, and coE,n are finite for all n > 2 and their images under 
the n-shift, denoted toy^n and coE,nf are exchangeable. 
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Case V: Restricting our attention first to V, we note that | W| = I implies 

limsupn”^ 1{W'^ (0,1)1 = lim 1{W'^ (0,1)1 = 0. 

_ _ n—>oo 


n^oo 

l<i,j<n l<i,j<n 


By the law of large numbers for exchangeable sequences, we can replace the upper limits 
in our definition of Lw(0 and |Sw(£)l by proper limits for cu-almosf every W € For 

any £, 6 > 0, cu-almost every W eV{e, 6) satisfies 


lim sup M ^ ^ IjW'-'(0,1)} 


l<i,j<n 


= limn-2 y ^ (0,1)1 

n—>co 


l<i,j<n 


= lim lim (nm) ^ ^ ^ (0,1)} 

n—>oo m—>oo 


i=i j=i 


II in 

lim n~^ y lim m~^ y 1{W^^ + (0,1)1 

n—>oo m—>oo 


1=1 

n 


;=i 


> lim n ^y el{i e Sw(£)l 

n—>oo 


1=1 


> e6 

> 0 , 


contradicting the assumption that cc-almost every W e has |W| = I. (In the above 
string of inequalities, passage from fhe second to third line follows from exchangeability 
and the law of large numbers and the interchange of sum and limif in the fourth line is 
permitted because the sum is finite and each of fhe limits exists by exchangeability and 
the law of large numbers.) Therefore, co assigns zero mass to V{e, 6) for all e,6 > 0, and so 
(U-almost every W € TRin must have |Sw(£)| = 0 for all £ > 0. In fhis case, eifher #Sw(£) < o® 
or #Sw{£) = oo- 

Treating the latter case first, we define the n-shift W„ of W € TTn as above, so that a)v,n 
is finite, exchangeable, and assigns positive mass to the event 

{W e TVn : \Sw{e)\ = 0 and #S|^^(£) = c«}. 

We can regard a)v,n as a constant multiple of an exchangeable probability measure On on 
TRin, so that for fixed n e IN the sequence (1{T|;^ (/) > £})ie]N is an exchangeable {0, Ij-valued 
sequence under 6„. By de Finetti's theorem, 

m 

|Sw(c)l = lim V 1{L^ (i) > £} = 0 0n-a.s., 

m^oo 

1=1 

which implies (i) = 0 for all i e IN oTy^-a.e., a contradiction. 

Now consider the case #Sw{£) < We claim that #Sw{£) = 1 almost surely. Suppose 
#Sw{£) = k > 2 so that {/i < • • • < 41 is the list of indices for which Lw{ij) > £■ Taking 
n = 1, we know that (jOv,n is a finite measure that is invariant under permutations that 
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fix [n]. Under the n-shift, cov,n is finite, exchangeable, and assigns equal mass to events of 
the form 

Ai = {]N e > £, ^ ^ ^ ^ ^ • 

Thus, if tjv,n{^i) > 0 for any i e IN, then tov,n has infinite total mass. Since this argument 
applies as long as #Sw{£) = k > 2, it follows that co must assign zero mass to {W € 'TV'in : 
#Sw(e) > 1}. 

On the other hand, if #Sw(e) = 1/ then a> must assign the same mass to all events 
Ai = {iN e TVin : Tw(0 > e, Tw(;) < £ for all ; i}. 

In this case, 

n 

(Uy({W e AVk ■ W|[„] ^ Id[„]}) < ^ cov,n{A) = na)v,n{M) < for all n 6 N, 

;=1 

which does not contradict (fTSl) . 

Since the above holds for all e > 0, there must be a unique vertex i 6 N for which 
Tw{0 > 0- f^y exchangeability and the right-hand side of dMll . is governed by a 

finite measure v,Z,/, where Vi > 0 and E, is the unique probability measure guaranteed by 
de Finetti's theorem. Thus, 

OO 

i=l 

Exchangeability of co requires that each term is equal, so there is a unique probability 
measure E and unique v > 0 for which 

OO 

(yy = v^qJ\ 

1=1 


Just as any exchangeable rewiring map determines a transition kernel from to 
any exchangeable {0,1} x (0, Ij-valued sequence determines an exchangeable transition 
kernel from (0,1} to (0,1}: let W = (W^, be {0,1} x (0, Ij-valued and for y = {x^)i>i in 

(0,1}^ define x' = W{x) by 

,,^rw^, Y' = o 

\ W\, x' = 1. 


A straightforward argument along the same lines as Theorem lS.lK with the obvious substi¬ 
tution of de Finetti's theorem for Aldous-FIoover) puts exchangeable {0,1} x (0, Ij-valued 
sequences in correspondence with exchangeable transition kernels on {0,1}^. The ergodic 
measures in this space are in correspondence with the unit square [0,1] X [0,1] and, thus, 
also the space of 2 x 2 stochastic matrices, allowing us to regard E as a probability measure 
on>S2. □ 


Case E: On event E, W‘> + (0,1) occurs for a zero proportion of all pairs i] and also a zero 
proportion of all / + i for a fixed i. For W e 'TF'n, we define 

Ew:= {/;: W'f ^(0,1)1, 

which must satisfy either #Ew = oo or #Ew < Also, since tjE,n is finite, we can write 
(OE,n dn for some exchangeable probability measure on for each n> 2. 


EXCHANGEABLE MARKOV PROCESSES ON GRAPHS: FELLER CASE 


27 


Suppose first that #Ew = oo. Then coe ,2 < implies W 2 ~ 62 is an exchangeable 
{0, l}-valued array with 

limsupn“^ ^ + (0,1)1 = 0. 

l<i,j<n 

By the Aldous-Hoover theorem, =0 a7E,2-almost everywhere, forcing all edges in 

Ew to be in the first row of W. As m —> 00 , coE^m forces all edges of Ew to be in the first 
m — 1 rows of W € "Win- By exchangeability, all elements of £w must be in the same row 
for (UE-almost every W € Thus, cue assigns equal mass to each event R; c E, where 

R; := {W € 'TT'in : i'f e E^ if and only if i e [i ',;'}} 

is the event that all non-trivial entries of W are in the ith row. 

For every n >2, ojE,n is exchangeable with respect to permutations that fix [n] ^ [n], and 
so is exchangeable for each n > 1 and 


m 

lim sup m-^ Yj 1 {+ (0,1)} 


0 . 


By de Finetti's theorem, W”'”'*'-' = 0 for all / > 1 almost surely, and so cuE^^^almost every 
W e "TVin must have #Ew < 00 , for every n >2. By the monotone convergence theorem, 
CUE-almost every W must have #Evv < °°- 

Now suppose that #Ew < 00 . Then cue = <^E,Ri, where cue,r, is the restriction of cue to 

R, for every z 6 N. By exchangeability, every cue^r, must determine the same exchangeable 
measure on {0, l}-valued sequences. By a similar argument as for Case V above, we can 
rule out all possibilities except the event that ^ (0,1) for a unique pair ij, i j. For 
suppose #Ew = k> 2, then there is a unique i e N such that 

i'i' 6 Ew if and only if i e {E, /'}. 

Without loss of generality, we assume i = 1 so that we can identify Ew = {/ e N : 
W^-' (0,1)} = {1 < zi < • • • < ik) with a finite subset of IN. We define n = - 1 
and Xw,f! = (1{W^'”''''' (0, l)})y>i. By assumption, *EoE,n is finite and exchangeable, and 

so Xw,fj is an exchangeable {0, l}-valued sequence with only a single non-zero entry. By 

exchangeability, *(OE,n assigns the same mass to all sequences in : / > 1}, where 

(zi -I- 1, zi -I- j) represents the transposition of elements n + 1 and n + j. It follows that Xw,n 
can have positive mass only if C 0 E,n has infinite total mass, a contradiction. 

On the other hand, if #Ew = 1, then we can express cue as 



where c^, > 0, and are the single edge update maps defined before d^ . and 

is the rewiring map W with all W' ^ = (Q, 1) except W’i = (1,0). This measure clearly assigns 
zero mass to IdjN, but it is exchangeable only if there are cq, ci,cio > 0 such that = cq, 
= Cl, and = cio for all / > z > 1. This measure is exchangeable and satisfies the right- 
hand side of (fT^ . Since p^^^ gives p'/q(W) = p^^(W) whenever W'-' = 0 and P*/q(W) = pQ (W) 
when W'^ = 1, we define eo = cq -i- cio and ei = ci -l- ciq. The proof is complete. 

□ 
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□ 

Proof of Theorem l3^ By Lemma 16.51 cu-almost every W e possesses a rewiring limit 
|W| and we can express a; as a sum of singular components: 

CO = (ol[\Yj\^i] + (ylj|w|=ii. 

By Lemma [6!^ the first term corresponds to Qy for some unique measure T satisfying (l44l) . 
By Lemma l6?7l the second term corresponds to vQi: + eoCo + eiCi for a unique probability 
measure L on S 2 and unique constants v, eo, ei > 0. The proof is complete. □ 

6.4. The projection into D*. Let T = {Tq : G e by an exchangeable Feller process 
and, for D € £)*, recall the definition of Tq = {Tt)t>o as the process obtained by first taking 
To ~ Yd and then putting To = Tg on the event Tq = G. We now show that the projection 
ITdI = (|rt|)t>o into D* exists simultaneously for all f > 0 with probability one. We also 
prove that these projections determine a Feller process on D* by 

|r2).| = {|rD|: Bern- 

Proposition 6.8. Let I = {F^ : G e be an exchangeable Feller process on For any 
D e Tf, let Id = (Ff)f>o be obtained by taking Fq ~ yu and putting Fd = Fg on the event Fq = G. 
Then the graph limit |Ff| exists almost surely for every t > 0. 

Proof For each D e D*, this follows immediately by exchangeability of Fq ~ Yd, exchange¬ 
ability of the transition law of F, and the Aldous-Hoover theorem. □ 

Froposition l6.8l only establishes that the graph limits exist at any countable collection of 
times. Theorem 13.71 establishes that |Tt| exists simultaneously for all f > 0. 

Theorem 13.71 LetT = {Tq : G e be an exchangeable Feller process on Then |r£).| exists 
almost surely and is a Feller process on D*. Moreover, each ITdI is continuous at all t > 0 except 
possibly at the times of Type (III) discontinuities. 

Recall that every D e D* corresponds to a probability measure yo on We equip 
D* with the metric (l28ll . under which it is a compact space. Furthermore, any v e 'V* 
corresponds to a transition probability Pi, on X and, thus, determines a Lipschitz 
continuous map v : D* —> D* through D i-> Dv as in (fl^ . Consequently, 

\\Dv - D'v\\ < \\D - D'W for all D,D' e D* and all veV. 

Proof of Theorem lT7l Existence. Fix any D e D* and let F^^j = (F|g^j)y>i denote the array 
of edge trajectories in Fd on the interval [0,1]. By the consistency assumption for F, each 
F|q is an alternating collection of finitely many Os and Is. Formally, each F|q = y is a 
partition of [0,1] into finitely many non-overlapping intervals // along with an initial status 
yo € {0,1}. The starting condition yo determines the entire path y = (yOfe[o,i]/ because y 
must alternate between states 0 and 1 in the successive subintervals //. 

We denote this space by I, and we write I* to denote the closure of I in the Skorokhod 
space of cMlag functions [0,1] ^ {0,1}. We can partition I* := where Jj!„ is the 

closure of 

{y e J* : y has exactly m sub-intervals}. 

Consequently, I* is complete, separable, and Polish. The fact that I* is Polish allows us to 
apply the Aldous-lToover theorem to study the J*-valued array T . 
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Since the initial distribution of Fd is exchangeable, the entire path satisfies 

(r°)t>o =£{^t)t>o for all permutations a : N —> N . 

In particular, the array Fjo i] of edge trajectories is weakly exchangeable. By the Aldous- 
Hoover theorem, we can express F as a mixture of exchangeable, dissociated X*-valued 
arrays. Thus, it suffices to prove existence of |y| = (|yf|)te[o,i] for exchangeable, dissociated 
J*-valued arrays Y = (Y'-'), j>i. 

To this end, we treat Y just as the edge trajectories of a graph-valued process on [0,1], 
so Y|^ denotes the status of edge ij at time t e [0,1] and 6 {F,Yt) is the limiting density 
of any finite subgraph F e Q* in Yf. To show that (|Yt|)fg[ 04 ] exists simultaneously at all 
t e [0,1], we show that the upper and lower limits of (6{F, Y|”^))„g]N coincide for all t e [0,1] 
simultaneously. In particular, for fixed F e Q,„, m e IN, and t e [0,1] we write 

5^ (F) := lim sup 6(F, Y|”^) and 

n^oo 

6-(F):=liminf6(F,Y|'^]). 

We already know, cf. Proposition l6.8[ that P{6+ (F) = 6“(F)} = 1 for all fixed t e [0,1], buf we 
wish to show that 6j^(F) = 6 ~{F) almost surely for all t e [0,1], i.e., 

P{sup,,[0 ij |6+(F)-6r(F)| = 0} = l. 

Each path = {Y\’)te[o,i] has finitely many discontinuities almost surely and so must 

every « e IN. For every e > 0, there is a finite subset Sg c [0,1] 
and an at most countable partition /i, / 2 ,... of the open set [0,1] \ Sj such that 

is discontinuous at s] > e for every s E Sg and 
PjY |q is discontinuous in //} < £, I = 1,2,.... 

Without such a partition, there must be a sequence of intervals (t - pn,t + Pn) with p„ ^ 0 
that converges tot ^ Sg such that 

P|r;i is discontinuous in (t - p„, f -I- p„)] > e for every n > 1. 

Continuity from above implies 

PjY^Q is discontinuous at f ^ Sj] > e > 0, 

which contradicts the assumption t ^ Sg. 

The strong law of large numbers also implies that 

12 ^ 

PjY is discontinuous in ft} = lim —-— > IjY'-' is discontinuous in /;] < e a.s. 

n^oo n(n - 1) 

' l<i<j<n 

for each sub-interval //, Z = 1,2,.... By ergodicity of the action of Sn for dissociated arrays, 
6+(F) and 6j'(F) carmot vary by more than e over // and, since i>^{F) = bp{F) almost surely 
for each endpoint of //, 

Pjsup,,^^ 16+(F) - a^F)! < 2£] = 1 
for all Z = 1,2,... and all £ > 0. 
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Since [0,1] is covered by at most countably many sub-intervals //, I = 1,2,..., and the 
non-random set S := U£>o Sf, it follows that 

P{supfg[Q |6^(F) - 6^(F)| < 2c} = 1 for all e > 0, for every F 6 

Continuity from above implies that 

lP{supfg [0 ij |6+(F) - 6“(F)| = 0} = limP{supfg [0 ij |6+(F) - 6“(F)| < 2e} = 1; 

thus, P{6(F, Yt) exists at all t e [0,1]} = 1 for every F e UmeN &[m]- Countable additivity of 
probability measures implies that this limit exists almost surely for all F e [JmeN^ni and, 
thus, P[ 04 ] determines a process on D* almost surely. 

The fact that these limits are deterministic follows from the 0-1 law and our assumption 
that y is dissociated. By the Aldous-Hoover theorem. To is a mixture of exchangeable, 
dissociated processes, so we conclude that | | exists almost surely for every D e D*. □ 

Feller property. By Corollary 16.41 we can assume F = {Fg : G 6 is constructed by 
Fq = (W*(G))t>o, for each G e where = (W*)f>o is a standard ca-process. The 
standard ca-process has the Feller property and, by Theorem l3.2[ 

\^t\ =£ |W(‘(Fo)| = |Fo||W(‘| a.s. for every t > 0. 

Existence of |Wj| at fixed times follows by exchangeability and analog to Proposition 16.81 
In fact, |W^| = (I Wf|)t>o exists for all f > 0 simultaneously by analog to the above argument 
for existence of | Fo |, because IdjN is an exchangeable initial state with rewiring limit I. The 
Markov property of | F^). | follows immediately. 

Let (Pf)f>o be the semigroup of |F£)-|, i.e., for every continuous function y : D* —> R 

PtgiD) = E(y(|Ff|) I |To| = D). 

To establish the Feller property, we must show that for every continuous g : ID* —> R 

(i) D i-> Ptg{D) is continuous for all t > 0. 

(ii) lim^o Ptg{D) = g{D) for all D e !D* and 

For (i), we take any continuous function h : ID* —> R. By compactness of D*, h is 
uniformly continuous and, hence, bounded. By dominated convergence and Lipschitz 
continuity of |Wf| : !D* —> D*, D i-> Pf/i(D) is continuous for all t > 0. 

Part (ii) follows from exchangeability of and the Feller property of F. To see this 
explicitly, we show the equivalent condition 

limP{|||W;| - III > £} = 0 for all £ > 0. 
tio 

For contradiction, we assume 

limsupP{|||Wj| - I|| > £} > 0 for some £ > 0. 

UO 

By definition of the metric (l28ll on D*, 

\\\w;\-i\\ = Y,2-" Yj 

neN Ve'W^n] 

and so there must be some n >2, some V e 'TV'[n] \{Id[n]}/ and e,Q> 0 such that 

(48) limsupP{6(P, Wf) > £} > p. 

UO 


EXCHANGEABLE MARKOV PROCESSES ON GRAPHS: FELLER CASE 


31 


Given such aV e \{Id[„]}, we can choose F e such that V{F) and define 

M-) ■= iMw ^ F] 

so that FtippiG) = F I To = G}. We choose any G = F* e such that F*|[„] = F. In 

this way, 

(F*) = P{r|”^ F I To = F’"} < PjFp^ discontinuous on [0, t]) 

and 

p{r[”^ ^ FI To = F*} > p{w;t'’^ = v} = EP{w;f”^ = f i \w;\} = e6(f, w;). 

Now, 

PlFp^ discontinuous on [0, f]} < 1 - exp{-t(u(W : W|[„] Id[„])) 

implies 

limsupP{Fp^ discontinuous on [0, f]} < limsup 1 - exp{-to(W : W|[„] + Id[„])} = 0, 

UO UO 

because cu(W : W|[„] + Id[„]) < oo for all « > 2 by the right-hand side of ([Mil . On the other 
hand, Markov's inequality implies 

E6(F, w;) > £P{6(F, W;) > £}, 

and (l48l) gives 

limsup E6(F, W^) > e limsup P{6(F, W^) > £} > ep > 0. 

UO UO 

Thus, the Feller property of F and fhe hypofhesis (|4^ lead to contradicting statements 

limsup Ft^’FiF*) > eg > 0 and 
UO 

limsupPti/^F(F’') < 0. 

UO 


We conclude that 

limsupP{6(F, Wf) > £} < ^ 

UO 

for all V e "^[n] \{Id[„]}, n e N, and all p, £ > 0. There are 4^ 2 ) - 1 < 4 ( 2 ) elements in 
'TF[„] \{Id[„]} for each n>2. Thus, 


p{6(id[„],w;)<i-£}<p 


U {6(F,W;)>£4-(2)} 

Ve'Win] \lld[„]) 


and we have 


lim sup P{6{Id[„], Wf) <!-£}< 

UO 

< limsup Yj P{6(F,W;) > £4“G)} 

TO yenV[„] \ild[„]) 

< Y limsupP{6(F,W;) > £4-(2)} 
venV[„]\(id[„]i ho 

= 0 . 
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It follows that 

limsup P{|6(y, W;) - b{V, IdN)l > £} = 0 for all e > 0, for all ^ € ^V[n], for all n e N. 

UO 

Now, for any £ > 0, the event {|||W*| - I|| > £} implies 

\\\w;\-i\\ = Y,^~" X ||w;i(y)-i(y)|>£. 

neN Ve'W[„] 

Since LvenV[„] ^ 2 for every n > 1, we observe that 

2“” Y - 1(^)1 ^2 Y < £. 

n>ri-log2(£)l Ve'Win] «>ri-log2(£)l 


Writing = 12- log 2 (£)l, we must have 

|6(y, w;) - b{V, IdN)l > (£ - 2-’”'+i)4-(”'^) > 0 
for some V € [Jn<me '^[n]- With g := {e - 2 ) >0, we now conclude that 


limsupP{|||WJ| - I|| > £} 
no 


< lim sup P y y {|6(y, w;) - 6{V, idN)l > e-} ■ 

UO \n<nic Venv^n] 

< lim sup E E p{|6(y,w;)-6{y,idN))l>e} 

UO n<m^ Ve'W[n] 

<- E E lim sup p{|6(y, w;) - 6{y, Wn)! > 

n<mc Ve'W[„] ^0 

= 0 . 


Where the interchange of sum and lim sup is permitted because the sum is finite. We 
conclude that |W*| —>p I as t J, 0 and |Wj(ro)| = |ro||W*| —>p IFqI as t J, 0. The Feller property 
follows. 


□ 


Discontinuities. Let To = (rt)t>o have exchangeable initial distribution yp). Then {|Tf|)f>o 
exists almost surely and has the Feller property. By the Feller property, | To | has a version 
with cadlag paths. For the cadlag version, lims-|-f |Ff | exists for all f > 0 with probability one. 
Although the map | ■ | : ^ is not continuous, we also have limsp |Ts| = |Tt_|, as we 

now show. 

Exchangeability of the initial distribution yp) as well as the transition probability implies 
To =£ T^ for all o e ®]n; therefore, Tt- is exchangeable for all t > 0. By the Aldous-Hoover 
theorem (Theorem l4.2ll . |Tf_| exists a.s. for all t > 0. 

Now, suppose f > 0 is a discontinuity time of To. If lirngp |Fs| |Tf_|, then there exists 
£ > 0 such that 

||lim|Fs| - |Tf_||| > £. 

sTf 

In particular, there exists m 6 iN and F e such that 


|lim6(F,F,)-6(F,Ff_)|>£. 
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By definition, 

6{F,r,)= lim^i Z 

n—>oo fi-l^ 

(p:[m]^[n] 

Since the above limits exist with probability one, we can replace limits with limits inferior 
to obtain 

0 < I hm inf hm inf Y l{rf = F} - l{rf_ = F}| < 

stf n—>oo ytim 


ip:[m]^[n] 


< limmfhmmf—— Y l{rf = F} - l{rf = F} 

stf n^oo Yi^m ^ ' S ' f- 

<p:[m\^[n] 

1 

< 21immflimmf—;— / llF^, discontinuous on Is, f)|. 

stf n^oo n^m ^ ' D 

>[n] 

By the bounded convergence theorem, Patou's lemma, exchangeability and consistency of 
r, and the construction of P from a standard ca-process, we have 


E 


1 

liminf lim inf —— / llPn discontinuous on Is, f)} 

sTf n^oo nlm L-k ^ ' 


s'lt n 


ip:[m]^[n] 

1 


< 


< lim inf lim inf —— Y EfllP^ discontinuous on [s, f))] 

stf n^co film ^ L LJ j 

(p:[m\^[n\ 

< lim inf lim inf 1 - exp{-(f - s)ca{{W e 'Wk : V^\\m\ + Idr^iDI 

stf 

= 0 . 


By Markov's inequality, we must have 


p||lim6(F,Ps)-6(F,Pf_)|>£| = 0 


for all £ > 0 and all F € Q*. 


It follows that 

P{|| lim |Ps| - |Pf-||| > £) = 0 for all £ > 0. 

sit 

To see fhaf the discontinuities in |r| occur only at the times of Type (111) discontinuities, 
suppose s > 0 is a discontinuity time for ITdI- The cadlag property of | Pd I along with the 
fact that limstf |Psl = |limstfPs|a.s. implies that |6(F,Ps-)-6(F,Ps)| > £ for some F 6 UmeN^[m] 
and some £ > 0. By the strong law of large numbers. 


lim 

n^oo 


2 

n{n - 1) 


l<i<j<n 


* r'^’l > 0, 


because otherwise exchangeability would imply 6(F,Ps-) = 6(F,Ps); therefore, there must 
by infinitely many edges with discontinuity at time s with probability one. Type (11) 
discontinuities can involve possibly infinitely many edges; however, there is a single fixed 
vertex i* for which all edges not involving i* remain constant. So, if s were the time of a 
Type (II) discontinuity, then 


lim 

n^oo 


2 

n{n - 1) 




lim 


l<i<j<n 


2 

n{n - 1) 


• n = 0, 
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a contradiction. Likewise, Type (I) discontinuities only involve a single edge, which cannot 
affect the limiting density of any subgraph. The proof is complete. 

□ 

□ 


7 . Concluding remarks 

Our main theorems characterize the behavior of exchangeable Feller processes on the 
space of countable undirected graphs. These processes appeal to many modern applica¬ 
tions in network analysis. Our arguments rely mostly on the Aldous-Hoover theorem 
(Theorem 14.21) and its extension to conditionally exchangeable random graphs (Theorem 
15.11) and, therefore, our main theorems can be stated more generally for exchangeable Feller 
processes on countable d-dimensional arrays taking values in any finite space. In particular, 
our main theorems have an immediate analog to processes in the space of directed graphs 
and multigraphs. 

In some instances, it may be natural to consider a random process on undirected graphs 
as the projection of a random process on directed graphs. Any G e projects to an 
undirected graph in at least two non-trivial ways, which we denote Gv and Ga and define 
by 

gJ’ := V & and 
dl := G‘i A 

Therefore, there is an edge between i and j in Gy if there is any edge between i and j 
in G, while there is an edge between i and j in Ga only if there are edges i to J and 
J to i in G. It is reasonable to ask when an exchangeable Feller process F on directed 
graphs projects to an exchangeable Feller process on the subspace of undirected graphs. 
But these questions are easily answered by consultation with Theorems 13.11 and 13.41 and 
their generalization to directed graphs. Similar questions might arise for exchangeable 
processes on similarly structured, but possibly higher-dimensional, spaces. In these cases, 
the analogs to Theorems 13.1H3.7I can be deduced, so we omit them. 
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